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To  a  large  extent,  the  network  has  become  an  even  more  important 
component  of  system  architectures.  Although  security  concerns 
remain  high,  especially  within  the  DoD,  there  has  been  a  clear  trend 
toward  linked  systems. 
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BACKGROUND  AND  CHALLENGES 


Background 

-  Weapon  system  investments  capture  a  significant  share  of 
defense  budgets 

-  Strong  emphasis  on  Jointness  generated  by  Capstone 
Concept  for  Joint  Operations  (2009) 

-  Joint  requirements  conveyed  to  systems  acquisition  process 
via  Joint  Capabilities  Integration  and  Development  System 
(JCIDS) 

Challenges 

-  To  what  extent  has  the  focus  on  joint  solutions  impacted  the 
acquisition  process? 

-  What  can  be  done  to  address  the  increasingly  complex  joint 
capabilities  requirements? 


Implications  of  JCIDS  Joint  Capabilities  Focus  in 
Systems  Acquisition 

•  Emphasis  on  developing  capabilities  to  support  Joint 
Operations 

-  Focus  on  benefits  of  multiple  systems  working  together  in  a 
‘systems  of  systems’  (SoS)  or  ‘net-centric’  context 

-  Existing  (legacy)  and  new  systems  are  required  to  work  together 
towards  the  capability  objective 

•  In  most  cases,  DoD  acquires  individual  systems 

-  Systems,  programs  defined  to  fulfill  specific  requirements, 
usually  in  functional,  service-specific  terms 

-  Capability-oriented  needs  (e.g.,  net-centric,  SoS)  may  put 
added  demands  on  systems  beyond  specified  requirements 

-  This  places  additional  risks,  costs  &  constraints  on  program 
execution 

•  Programs  impacted  by  external  issues  (interdependencies) 

•  Difficult  to  capture  in  baseline  estimates 

•  Manifested  as  cost  growth,  schedule  delay  &  performance  shortfall 


Acquiring  Defense  Capabilities:  Nonlinear  Scale 
Effects  and  Interdependence 

•  Conventional  measures  of  size  no  longer  predict  effort  & 
cost  at  the  extremes 

-  Nonlinearity  in  scaling  effects  break  conventional  cost  models 

-  Fail  to  account  for  increased  integration  &  coordination  costs 

•  Extra-programmatic  factors  confound  traditional  methods 

-  Unpredictable,  chaotic  nature  of  program  interactions  reduce 
management  control 

-  Adverse  incentives  regarding  external  factors  impede  proactive 
planning 

•  Not  just  a  Joint  Program  or  SoS  Problem 

— Any  program  can  be  affected 

-  Evidence  of  Interdependence  among  programs 

-  Explicit  (as  in  SoS)  or  implicit 

-  Can  take  many  forms 


Examining  interdependence  as  a  distinct  feature  may 
provide  useful  insight  into  program  behaviors 


Unpacking  Interdependence: 

Three  Dimensions  of  Interdependence 


operational 


Operational  -  Mission,  goals,  objectives,  and 
their  fulfillment,  e.g.,  Joint  CONOPS,  Tactics, 
Techniques  &  Procedures 


Current  Treatment  of  Interdependence 


•  Current  DAES  View  provides 
some  insight  regarding 
interdependence 

•  Concern  about  consistency  & 
objectivity  of  format 

•  Most  relationships  with  non¬ 
reporting  programs 

•  Hard  to  assess  program  risk 
from  this  representation 


DAES  Depiction  of  Interdependence 
(representative) 


Interrelationships,  Dependencies  and  Synchronization 
with  Complementary  Systems  for  DAES  (Chart  5) 
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Interrelationships,  Dependencies  and  Synchronization 
with  Complementary  Systems  for  D AES  (Chart  5) 


Study  Approach  Overview 


DAES 

Charts 


Combat  Systems: 


SAR 
(DAMIR) 


Budget 
Exhibits 


UNCC  Effort 

“Programmatic” 

Interdependence 


SAR 

(DAMIR) 


Data 


Raytheon  VTC  Effort 
solidated  Data  Set  (MMT) 


SAR 

(DAMIR) 


Independent  Variables 
(Interdependence) 


Dependent  Variables 
(cost,  schedule) 


Data 


Test  Hypotheses 
Develop  Risk  Indicators 
Create  integrated  model 


•Performance  Shortfalls 


Technomics  Effort 

“Constructive” 

Interdependence 


SAR 

(DAMIR) 


Apply  to  Acquisition 
Processes 

•Improve  cost  models 
•Assess  program  risk 
•Inform  resource  req’ts 
•Etc... 


•Number  /  Diversity  of  Stakeholders 
•Funding  Diversity 
•Number  of  Program  Elements 
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Views  of  Programmatic 
Interdependence 
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Compilation  of  program  dependencies  as  depicted  in  2007  DAES  charts 


Programmatic  Interdependence:  Network  View 


All  MDAPs  are  interdependent  in 
multiple  ways 

Programs  defined  as  “Joint”  are 
not  obviously  more 
interdependent  than  non-joint. 

MDAPs  are  linked  mainly  to 
programs  that  are  not 
required  to  report  on  program 
status. 


O  Non-MDAP/  Non-Reporting 
O  Net  SDD  Decrease 
•O-  SDD  Growth  1-14% 

^  SDD  Growth  15-50% 

□  SDD  Growth  51-100% 


Interdependencies  from  DAES  charts  for  programs  post  M/S-C; 


SDD  Growth  >  100% 


Cost  growth  data  from  SAR 
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Programmatic  Interdependence 


Evolving  Over  Time 


Year 

Number  of 
Linkages 

Number  of 
MDAPs 

Number  of 
Program 
Elements 

Ratio  of 
PE's  per 
MDAP 

Number  of 
Links  per 
MDAP 

Number 
of  Links 
per  PE 

1997 

82 

24 

80 

3.3 

3.4 

1.03 

1998 

96 

26 

92 

3.5 

3.7 

1.04 

1999 

87 

26 

84 

3.2 

3.3 

1.04 

2001 

113 

31 

104 

3.4 

3.6 

1.09 

2002 

116 

35 

105 

3.0 

3.3 

1.10 

2003 

117 

37 

106 

2.9 

3.2 

1.10 

2004 

135 

44 

120 

2.7 

3.1 

1.13 

2005 

159 

50 

135 

2.7 

3.2 

1.18 

2006 

257 

92 

218 

2.4 

2.8 

1.18 

2007 

319 

95 

257 

2.7 

3.4 

1.24 

Number  of  Links 
from  MDAPs  to  Program 
Elements  increases  over 
sample  period  (1997-2007) 
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2004 

Suggests  program 
interdependence  emerges  as 
clusters  of  collaborating  programs 


Data  from  SAR 


Program  Funding 
Relationships  : 
Multi-Program  Clusters 
have  proliferated  and 
expanded 

2007 


Resource  Sharing  Among  Programs 


...suggests  programs  are  becoming 
more  interdependent  through 
shared  resources 


Increasing  “connectivity”  among  programs 
via  their  funding  program  elements... 


Links  per  Nodes  for  Program 
Elements  in  2007 
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Constructive  Interdependence:  Methodology 


Information  Support  Plans  and 
DoDAF  Artifacts  provide 
insight  into  the  “constructive” 
dimension  of  interdependence 


Simple  counting  rules 
create  objective  measures  of 
interdependence  and  complexity 


Systems 
Node, ,  N1 


N2 


Item 

Value 

Systems  Nodes,  N 

Send/Receive  ,Ns/r 

3 

Send,  Ns 

0 

Receive,  Nr 

1 

Total,  Nt 

4 

Links, L 

Uni-  directional,  Lud 

2 

Bi-  directional,  Lbd 

3 

Total,  Lt 

5 

Metcalfe  Number,  LtMax 

6 

Integration  Density,  Lt/LtMax 

5/6 

Links  per  Node,  L  t/Nt 

5/4 

Constructive  Interdependence:  Emerging  Patterns 


Integration  density  within 
MDAPs  shows  remarkable 
consistency  over  a  wide 
range  of  programs 

Suggests  some  underlying 
principle  guides  the 
evolution  of  complex 
systems 

Relationship  has  practical 
utility  for  inferring 
development  effort  with 
respect  to  scale 


Data  from  SAR  /  ISP 


Correlation  with  Resource  Demand 


Data  suggest  a  nonlinear  relationship  between  measures  of  interdependence 
&  complexity  and  development  resource  demand  (measured  in  RDTE  $) 

Stronger  correlation  between  Links  consistent  with  the  notion  of 

interdependence  being  a  key  driver 


Formulating  a  Model 

Simple  relationship  between  numbers  of  nodes  and  links  does  not  account  for 
the  following  effects: 

-  Send  /  Receive  nodes  are  more  complex  than  Send-only  or  Receive-Only; 

-  Send-only  nodes  are  more  complex  than  Receive-Only 

-  Nodes  that  have  more  links  are  more  complex  than  nodes  with  fewer  links. 


“Effective  Nodes”  ...“plugs  in”  to  a  simple  nonlinear 

formulation  to  account  for  relationship  for  RDTE$  in  terms  of 

relative  node  complexity. . .  “Effective  Nodes” 


Refining  the  Model 


N  =  (N  .  +0.5N  +0.29N  ) 
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1.22 
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Model  parameters  resolved  through 
optimization  against  MDAP  data  set 


RDT&E  FY 08$M  =  20.7 Nj'38  Significant  correlation  over  large 

range  of  MDAP  size  /  complexity 
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Model  provides  method  to 
translate  measures  of 
interdependence  derived  from 
authoritative  data  into 
estimates  of  development 
resource  demand 

This  correlation  may  be  of  significant 
utility  for  assessing  program 
development  needs  or  risk 

Data  from  SAR  /  ISP 


Findings/Implications 


1)  Interdependence  is  pervasive  among  systems.  Limiting 
consideration  of  interdependence  to  programs  designated  as  joint 
or  part  of  SoS  is  insufficient. 

2)  Interdependence  among  programs  is  increasing,  possibly 
spontaneously  to  address  increasing  demands  for  joint 
capabilities. 

3)  traditional  methods  of  analyzing  risk,  while  important,  need  to  be 

supplemented  with  network  analysis  techniques  to  reveal  the  true 
scope  of  the  effects  of  interdependencies. 

4)  Existing  data  resources,  even  the  relatively  aggregate  SAR  data  and 
the  often-disparaged  DoDAF  artifacts,  when  combined  in  an 
analytically  rigorous  manner  over  a  sufficiently  large  sample,  can 
provide  significant  insights  into  program  behaviors. 

5)  Continued  exploration  into  the  nature  and  effects  of 
interdependence  is  likely  to  yield  further  insights  and  benefits 

For  the  paper  and/or  data  set,  please  contact 
Rob  Flowe  at  (703)  602-0851  xl 21 ;  robert.flowe@osd.mil 


